Apparatus, system and method for tracking  subject with still or video camera

ABSTRACT

An apparatus, method, and system for controlling camera aiming and operation through a convenient and intuitive interface using correlative touch and feel, which allows a camera operator to primarily pay attention to a game or event, while simultaneously controlling a still or video camera in three control dimensions, with a high degree of accuracy or quality.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority under 35 U.S.C. §119 to provisionalapplication Ser. No. 61/567,476 filed Dec. 6, 2011, herein incorporatedby reference in its entirety.

I. BACKGROUND OF THE INVENTION

Many people, who attend events such as sports games, concerts, weddings,etc., desire to both watch the event and photograph or video record theevent for later enjoyment. Currently it is very difficult to do both.Either one will pay close attention to the camera and thus miss theenjoyment of the live event, or one will concentrate on the live event,with the result that the photographic record of the event is of poorquality. Though it is possible to simply set a still camera in a singlelocation with, for example, a remote shutter release, or to place avideo camera to record the entire sports playing area, the results ofdoing so are normally unsatisfactory. Also, for sports and other events,one particular player or performer may be of special interest to aspectator (e.g., parents watching their child playing basketball,performing on stage, etc.). But tracking a single individual back andforth down a basketball court or across a stage requires constantattention and detracts from the enjoyment of the event.

Servo control methods for operating still or video cameras are known inthe art. For example, the “AXIS 295 Video Surveillance Joystick”commercially available from Axis Communications Inc. (100 Apollo Drive,Chelmsford, Mass. 01824) has a three-axis Hall-effect joystick, 12programmable push-buttons and USB interface, and integrates with videosurveillance software platforms recognizing joystick inputs viaMicrosoft's DirectX application programming interfaces from MicrosoftCorporation, Redmond, Wash. (USA). An example of video surveillancesoftware is “Axis Camera Station” software, commercially available fromAxis Communications. Information about the AXIS 295 Video Joystick andAXIS Communications Software can be found at AXIS 295 Video SurveillanceJoystick, Installation Guide© Axis communications AB2006, Rev. 1.0, PartNo. 26393; AXIS Camera Station USERMANUAL©, 2004-211, Ver. M2.7, PartNo. 44738; and (P-Surveillance Design guide©, 2008; all from AXISCommunications, Inc., Chelmsford, Mass. (USA), and each incorporated byreference herein. Remote control pan and tilt units allow an operator tocontrol many parameters of camera operation; however these units requirethe full attention of the operator to some kind of viewing screen thatis either attached to or remote from the unit. The result is that theservo control systems are little different from a simply watching theevent on screen or through a viewfinder while manually controlling acamera and do not allow for the user to enjoy watching the event ‘live’instead of on a view screen. See also U.S. Pat. No. 6,977,678,incorporated by reference herein.

Therefore, there is need for a method, system, and apparatus forrecording events and tracking subjects or persons which allows thecamera operator to enjoy the event in real time. Specifically, there isa need for an apparatus, system, and method of kinesthetic control or“correlative touch and feel control” to control directional orientationof a still or video camera by methods that do not require constant orexcessive watching of a viewfinder or video screen, and that allowintuitive manual control of camera aiming.

This correlative touch and feel control should take advantage of thebody's ability to accurately do multiple tasks simultaneously,especially in the case where one task is a repetitive motor skill. Inother words, using this ability, an observer can both watch an event andcapture images without having to choose one or the other, and withoutsignificantly distracting either from the enjoyment of watching theevent or from achieving high quality image capture.

Kinesthetic control, described herein as correlative touch and feelcontrol is known as a means of control of mechanical equipment. Forexample, while the present document relies in general on commonknowledge of the human ability to control mechanical systems, papers byWilliam T. Powers “A Brief Introduction to Percepted Control Theory”©2003; (see http://www.frontier.net/˜powers_w/whatpct.html) and CharlesC. MacAdam (seehttp://deepblue.lib.umich.edu/bitstream/2027.42/65021/1/MacAdam_(—)2003%20VSD%20Understanding%20and%20Modelling%20the%20Driver.pdf, and VehiclesSystem dynamics, 2003, vol. 40, Nos. 1-3, pp. 101-134, Swets &Zeitlinger, incorporated by reference herein) provide an introduction tothe theoretical basis for human control mechanical systems. Kinestheticcontrol is defined here as using finger, hand, arm, or other bodymovement in conjunction with a learnable physical and spatial interface,to control, direct, or influence a physical result. The control motionsmay correspond directly to a desired outcome (such as an individualpiano key playing one note, or a computer key typing a single letter);may provide a signal that changes an object's position (such as thehydraulic control lever on a backhoe or excavator); or it may controlthe speed or other variable parameter of an object (such as theaccelerator pedal on a car changing the car's speed). In these cases,after a period of learning, the body adapts to touch and feel controlwhich provides either an absolute or relative reference to the desiredoutput by either providing a one-to-one input/response sequence (e.g.the piano key), by making a change to the current state of the parameterbeing controlled (e.g. the hydraulic lever or accelerator pedal), or bymaking some other specific output response to a given physical input.

Using correlative touch and feel to control equipment is known in manyfields other than photography. For example, an automobile relies on theuse of a “correlative touch and feel” interface which requires aninitial learning period, but which can then be operated very naturallywith little singular focus given to the psycho-motor skills which arenecessary. At first, learning to drive an automobile requires intenseconcentration. The learner must grasp the relationships of the motion ofcontrols (the steering wheel, accelerator, clutch and brake pedals,gearshift, etc.) to the actual movement of the vehicle. And though thelearner may control the vehicle very poorly at first, he or she soonreaches a level of mastery that allows the vehicle to be controlledalmost entirely by correlative touch and feel. This control allows thedriver to view and enjoy the scenery while maintaining smooth operationof the car. Control is maintained over different driving conditions suchas city traffic, expressway speeds, curving and uneven country roads,etc., while the driver makes only occasional reference to the dash panelto glance at the speedometer and other instruments or to make sure of acontrol location.

Another example of this type of learned control of equipment is theoperation of computer, ten key, and calculator keyboards. For example,while someone who is new to keyboard use may only be able to type a fewwords per minute, an experienced typist can input 50 to 100 words perminute with almost no conscious thought applied to the location of thekeys, beyond initially feeling the reference marks typically found onthe ‘F’ and ‘J’ keys. And what is mentally tiring at first—finding thekeys in the order of words being scanned by eye—becomes second nature sothat the fingers seem to respond almost independently of the eyesscanning a text that is being copied such that words and sentencesinstead of individual letters seem almost to flow from the keyboard.

Other examples of this type of learned control of equipment includeflying airplanes; operating construction equipment such as a loader,backhoe, or excavator; controlling software operations (such as e.g.photo editing software) using computer input devices such as a mouse,pointer, touchpad, etc.; and playing musical instruments such as piano,accordion, xylophone, etc.

Control systems generally use a defined space to provide a general setof limits through which the manual control takes place, based on varioustypes of sensory inputs. For example, a car has an operator station(seat) which positions the driver in a known physical relationship tofoot controls (clutch, brake, accelerator), and to hand controls(steering wheel, gearshift, turn signals, wipers, radio, etc.). Withinthese bounds, through practice, the body quickly learns to provideinputs to the vehicle. The driver then interprets the movements of thecar by observing several types of input. The view out the windshield isthe most common input. Other inputs to the operator include the view inthe rear-view mirrors, the position of a speedometer needle, presence orabsence of indicator lights, the relative position of a turn-signallever, road noise and vibration, and even things such as the memory ofthe physical location of an output—such as the memory of the manualgearshift position after an upshift from third to fourth gear.

These inputs are organized by the brain to provide a “sense” of thecar's operation which includes but is not limited to the visualperception of the location of the vehicle. Often inputs provideredundant feedback which serves to either confirm a single input or to“flag” that input for verification. For example, the sense ofacceleration provided by the driver being forced into the seat (or moreaccurately in real physical terms, the seat applying a force to thedriver) and the sound of the engine (volume and timbre), along withknowledge of gear selected, road conditions, and previous speed allows adriver to very closely estimate vehicle speed, such that a visual scanof the speedometer may only be made when a speed limit sign or policecruiser is sighted. This results in smooth and skillful operation of thevehicle by an experienced driver devoting very little consciousattention to driving. In contrast, someone just learning to drive willtry to visually scan the speedometer frequently but is much more likelyto control vehicle speed quite unevenly. As a result of the body'sability to process and interpret many inputs, someone driving a car istypically aware only of making occasional visual reference to thevehicle speedometer to reassure and confirm correct operation, when infact a great number of inputs are simultaneously being processed andevaluated.

Still further, the noteworthy adaptability of drivers to differentvehicles shows how easily persons can “calibrate” their own sensoryinputs to a varying control interfaces. To continue the vehicle analogy,the same person can easily move from a very small compact car with anautomatic transmission and unresponsive acceleration, steering, andbrakes, for example, to a highly responsive sports car having quickthrottle, braking, and steering response, to an over-the-roadsemi-tractor having a thirteen speed manual transmission, and anoperator seat (and therefore an operator visual reference point) higherthan the roof of most cars.

While such operator control has been applied to some things, such asdiscussed above, it has not been applied to others. In the case ofautomobiles, backhoes, and the like, the operator kinesthetic controltranslates minute human motor control of a relatively few separate anddedicated controls (e.g., steering wheel, accelerator, brakes) into muchmore powerful mechanical forces and movements. In the case of musicalinstruments or computer keyboards, fine human motor control manipulatesa larger number (e.g., standard piano has 88 keys, most computerkeyboards have well over 50 keys) of separate one-function controls(e.g., one key for one note, one key for one letter) but to produce notmechanical power or movement, but some quite different output (e.g.,sound energy or digital data that can be translated to letters orwords). In these cases, the expense and complexity of the hardware forkinesthetic control and the value of its output is justified. However,those factors militate against kinesthetic control in other situations.

A need has been identified for improvements in the art of photographingor imaging a live event. Given a short time for learning, an operator ofthe system as described herein should be able to control a video orstill camera, or even multiple cameras, with very little consciousthought given to the process and with highly satisfactory results, basedon the body's ability to virtually automatically coordinate andassimilate multiple sensory inputs into a mental sense of the state ofphysical objects while performing other mental functions, particularlywhen the first function involves repetitive psychomotor skills.

II. SUMMARY OF THE INVENTION

Aspects of the invention as envisioned provide a method, system, andapparatus for controlling camera aiming and operation through aconvenient and intuitive interface using correlative touch and feel,which allows a camera operator to primarily pay attention to a game orevent, while simultaneously controlling a still or video camera in threecontrol dimensions, with a high degree of accuracy or quality.

It is therefore a principle object, feature, advantage, or aspect of thepresent invention to improve over the state of the art and/or addressproblems, issues, or deficiencies in the art.

Aspects of the invention as envisioned can use a touchpad-type interfaceto provide two-dimensional ‘X-Y’ control with reference to a singleplane (such as the horizontal plane of a basketball court, the verticalplane of action of a concert, wedding, or other event) for camerapan-tilt.

The touchpad may be an LCD screen or a tablet type computer such as aniPad®, with an interconnected camera, wherein certain locations on thetouchpad correspond to given locations within an area such as abasketball court.

The touchpad may be mounted on a camera tripod at a convenient locationto allow touchpad operation, or it may be hand-held or placed in the lapor on any available surface. A camera with electro-mechanical pan andtilt (PT) control can be mounted on a tripod or other suitable stablelocation. Interface cables are connected to typical connectors on thetouch screen unit. The touchpad may include a display screen. The cameramay also be mounted remotely and connected by a cable or wirelessly toother system components. A variable slide, trigger, or other inputdevice can provide a third 7′ or “depth” control for camera zoom (othercamera functions such as focus, f-stop, etc. could also be controlledusing the same trigger or another mechanism). The ‘Z’ control may beseparate from the touchpad, or may be attached to or made as a part ofthe touchpad.

Simultaneous enjoyment and imaging or recording of events is thusobtained. In one possible aspect of the invention, the combination ofthe two dimensional (2D) ‘X-Y’ correlative touch control with the 3rddimension ‘Z’ trigger control can provide the heretofore unavailableability to enjoy watching an event such as a game or concert even whilesimultaneously capturing still or video images, without losing theaccuracy of three dimensional (3D) control of the imaging camera.

These and other objects, features, advantages, or aspects of the presentinvention will become more apparent with reference to the accompanyingspecification and claims.

III. BRIEF DESCRIPTION OF THE DRAWINGS

From time-to-time in this description reference will be taken to thedrawings which are identified by figure number and are summarized below.

FIG. 1 illustrates one exemplary embodiment of a system of componentsaccording to aspects of the invention relative to an exemplary target(here a basketball court).

FIG. 2 illustrates, in enlarged sale, touchpad 20 of FIG. 1, andillustrates an exemplary input point 200 on touchpad 20 corresponding toa given camera view.

FIG. 3 illustrates an optional secondary camera 70 of FIG. 1 in enlargedscale.

FIG. 4 illustrates camera 50 and pan and tilt unit 60 of FIG. 1 inenlarged scale, and illustrates a camera view 205 corresponding to agiven touchpad input.

FIGS. 5A-B illustrate a touchpad 20 of FIG. 1 in enlarged scale and anoverlay 110 that may be used according to aspects of the invention.

FIG. 6 illustrates positional reference helps which are used withoverlay 110 and touchpad 20.

FIG. 7 illustrates overlay 110 in use on touchpad 20.

FIG. 8 illustrates an exemplary trigger control 210 of FIG. 1 inenlarged scale.

FIG. 9 is a flow chart of an exemplary calibration and operation methodaccording to an exemplary embodiment of the present invention.

IV. DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

A. Overview

To further understanding of the present invention, specific exemplaryembodiments according to the present invention will be described indetail. Frequent mention will be made in this description to thedrawings. Reference numbers will be used to indicate certain parts inthe drawings. The same reference numbers will be used to indicate thesame parts throughout the drawings unless otherwise indicated.

Certain embodiments according to aspects of the invention as envisionedprovide an apparatus, system and method for controlling camera aimingand operation through a convenient and intuitive interface usingcorrelative touch and feel, which allows a camera operator to primarilypay attention to a game or event, while simultaneously controlling astill or video camera in three control dimensions, with a high degree ofaccuracy or quality.

B. Exemplary Method and Apparatus Embodiment 1

An embodiment according to aspects of the invention use a touchpad-typeinterface to provide two-dimensional ‘X-Y’ control with reference to asingle plane (such as the horizontal plane of a basketball court, or thevertical plane of action of a concert, wedding, or other event) forcamera pan-tilt. The touchpad may be of the type shown as item 20, FIG.1, such as an LCD screen or a tablet type computer such as an iPad®,with an interconnected camera 50, FIG. 1 and FIG. 4, wherein certainlocations on the touchpad correspond to given locations within an areasuch as a basketball court 100.

In one example, the basketball court displayed on touchpad 20 can be arendering or graphically produced simulation of actual basketball court100 of FIG. 1. It could be highly stylized or simplified to displaycertain commonalities with actual court 100, (e.g., basic proportionalsize but not absolutely required, landmarks such as outer courtboundaries, half court line, free throw lines, positions of basket, andthe like). In one example, the image of the court could be generic suchthat it could be reused for almost any basketball court. The conceptwould be that the rendering or simulated image of the court on the touchscreen provides visual indication of the basic geometry and landmarks ona basketball court. Another possibility would be to provide an image ofthe actual court 100 on the touch screen display and have software thatwould allow the user to touch points around the boundary of the court aswell as landmarks like mid line, free throw lines, and basket positions,and then the software would basically understand where on the screenspace the different locations on the court are. It would be similar toputting in way points in a GPS system which would remember the pointsand their relative location to other points. In that way, a touch on thetouch screen in operation would then know where the relative position ofthat touch on the touch screen would be to the image of the basketballcourt, which could then be correlated to the actual basketball court.For example, the Cintiq 21UX Pen Display monitor (commercially availablefrom Wacom Americas, Vancouver Wash.) may be used with commerciallyavailable Adobe Photoshop® software (available from Adobe, San Jose,Calif., US) to provide this kind of interface. As can be appreciatedfrom the foregoing, the basic concept is that what is displayed on thetouch screen provides some visual representation of the event location(in this example a basketball court) such that significantcharacteristics like boundaries, and landmarks, can be discernedrelative to the touching of a point on the screen such that all of thesame can be correlated to the actual event location 100 (here basketballcourt 100).

The touchpad 20 may be mounted on a camera tripod 10 at a convenientlocation to allow touchpad operation, or it may be placed in the lap oron any available surface. Camera 50 with electro-mechanical pan and tilt(PT) control 60 is mounted on tripod 10 or other suitable stablelocation. One example of a commercial PT control is the Bescor MP-101Motorized Pan Head, available from Bescor Video Accessories Ltd., 244Route 109, Farmingdale, N.Y. 11735. See also U.S. Pat. No. 7,527,439,incorporated by reference herein.

Interface cables 40 are connected to typical connectors 30 on the touchscreen unit. Touchpad may include screen 90, or screen 90 may beprovided as a separate ‘monitor’ which is used to show the currentcamera view. In this case, the screen 90 might be attached to a seatback in front of the operator, with the touchpad 20 in the user's lap,while the camera 50 is mounted on a tripod at the end of the row, in abalcony, or other location which provides a good view while notobstructing other observers. Camera 50 may also be mounted remotely andconnected by cable or wirelessly to other system components.

A variable slide, trigger, or other input device provides a third ‘Z’ or“depth” control for camera zoom. The trigger control may be of thegeneral type shown as item 210, FIG. 1 and FIG. 8, and may be separatefrom touchpad 20, or may be attached to or made as a part of thetouchpad. Other camera functions such as focus, f-stop, etc. could alsobe controlled using the same trigger or another mechanism. As can beappreciated, as with many commercially available computer peripheralssuch as joy sticks, ‘mouses, track balls, touchpads, wirelessgyroscope/accelerometer based controllers as with commercially availableWii™ (systems available from Nintendo Co. Ltd., Kyoto, Japan;http://www.nintendo.com/?country=US&lang=en), the ‘Z’ or depth controlcould be a separate control device which is manually operated. Withregard to integrating it on a touch screen or on another control (e.g.,additional buttons or controllers on a joy stick or wirelesscontroller), the designer could make such control easy to locate andaccess during operation.

A true innovation in simultaneous enjoyment and imaging or recording ofevents is thus obtained. Specifically, the combination of the 2D ‘X-Y’touch control with the 3rd dimension ‘Z’ trigger control provides theheretofore unavailable ability to enjoy watching an event such as a gameor concert even while simultaneously capturing still or video images(such as illustrated by the screen 205 in FIG. 4) without losing theaccuracy of 3D control of the imaging camera.

Calibration

In one embodiment, for use, a calibration procedure is performed by theuser, wherein the camera 50 view is correlated to the touch screen.During this procedure, an overall view or representation of the court100 (e.g. 105, FIG. 2) is generated and displayed on the screen 90.(Depending on the specifications of the camera and the location ofcamera 50 relative to the venue, this overall view may simply be asingle wide angle capture of the camera's viewing area, or it may becomposed from multiple captures of smaller areas. Or a separate still orvideo camera 70, FIG. 1 and FIG. 3, could be used to provide the overallview.) Then the boundaries of desired viewing area, such as the cornersof the playing court, are correlated to camera positions using asoftware procedure. (An example of such software is included below, see“Example of Camera positioning based on Touch Screen Input”). Again, ananalogous example is the ability on a touch screen to place way pointson a map such that the GPS/map system remembers the way points as wellas their relative location to other points on the touch screen. Forexample, the camera is positioned and zoomed in accurately to the upperleft corner of the court, and the user touches the corresponding cornerof the touch screen. This is repeated for the other three corners of thecourt, then as many intermediate points (such as 200 of FIG. 2 as justone illustrative example) as are necessary may be selected andcalibrated. These points might include both ends and the center of thehalf-court line, the center of each free-throw line, and two or morepoints on each three-point line. The final step might be the usertracking multiple points on touchpad 20 while verifying that camera 50is accurately viewing the corresponding points on the court.

Alternatively, the view screen on camera 50 could be used to indicatecamera positioning relative to user input, apart from the use of screen90. The user could simply point camera 50 to a desired view and touchthe touchpad 20 in order to calibrate camera 50 to the touchpad area 90.After calibration, the user would provide input to the touchpad andverify using the camera view screen that camera 50 was correctlyfollowing touchpad inputs.

An exemplary specific calibration method is illustrated in FIG. 9.

Operation

After calibration, the user can initiate the ‘record’ mode on the cameraand simply tracks the action on the court with finger movement on thetouch screen. Controls to interface with the camera could be included inthe touch screen interface and the trigger interface to allow the camerato be paused, to zoom in and out, or to control other camera features.During the game, the user may reference the screen as much as desired toverify the camera is tracking accurately, and might take the opportunityduring any interruptions in play to adjust or correct the calibration.

The display on the touchpad, if used, might also display the actual areabeing viewed by the camera. “Grabbing” and “panning” the view in thedisplay could be used to control the camera instead of “pointing” thecamera to an area displayed on or represented by the touchpad. Theconcept of “grabbing” and “panning” is known in the art, seehttp://www.globalmapper.com/helpv7/Help_ToolsMenu.html, User's manualavailable at http://www.globalmapper.com/helpV12/Help-Main.html. Someusers might find this interface easier to use. It would allowverification of the camera view and might be less susceptible toinadvertent movements of the camera tripod or mount. However it mightrequire more frequent views of the touchpad in order to ensure that thecamera is capturing the desired image, which could in turn lessen theperceived benefit of the device.

Control

Control of the camera PT unit 60 might be with a single finger tracingthe action on touchpad 20. Based on programming and correlations betweenthe virtual display of the event location on touchpad 20 and the actualevent location relative to the actual camera 50, the finger tracingwould be interpreted by the software into instructions that wouldgeometrically be converted to change pan or tilt to change the aimingdirection of the camera relative to the actual court 100. While this isa conversion of a two-dimensional finger trace on a two-dimensionalsurface into a court and camera in three-dimensional space, bycalibration and programming, the correlations would generally besufficient to move the camera field of view in the intended manner ofthe finger trace. In other words, the field of view of the camera wouldnormally capture at least a substantial portion, as opposed to a smallpoint, of the court. Thus, if the finger trace generally moves theaiming direction of the camera in the same intended way as the fingertrace it should be sufficient to normally capture the intended field ofview changes of the operator. The trigger 220 in FIG. 8 could be used toadjust camera zoom by pushing the trigger forward to zoom in and pullingthe trigger out to zoom back. Of course, the zoom concept would be quitediscretionary on the part of the operator. Such would not change theaiming direction of the camera but rather the magnification of therecorded image. This also normally does change the size of the field ofview relative the actual court 100. The operator could glance at thecamera display, if available, to double check field of view.Alternatively, the software might change the simulated field of view onthe touch screen to approximate the level of zoom instructed to thecamera to allow the operator to glance at that for context. Anotherexample could be a screen within a screen on the touch screen that givessome feedback on field of view. Other possibilities are within the skillof those skilled in the art. The trigger 220 could provide feedback bytrigger position, detents, engraved or embossed marks (such as e.g.,“w”, “n”, “z” in FIG. 8, for wide angle/normal/zoom), etc. to provide areference for one or more intermediate zoom levels. Also oralternatively, multiple or repeated finger movements on the touchpad(such as tapping or spreading two fingers apart for zoom in, ortouch-and-hold, or pinching fingers together for zoom out) could beused. This type of touch screen manipulation is becoming ubiquitous withtouch screens on Smart Phones, iPads, and the like. Combinations ofcontrol inputs could be used as well, such as separate buttons for fullzoom in, full zoom out, and ‘normal’ modes and/or trigger use forinfinite variation between extremes. Thus, in one embodiment, one handwould control camera pan and tilt through the touchpad, and the otherwould control camera zoom through the trigger. Alternatively, thetrigger, a knob, slider or other control could be attached to orintegrated with the touchpad to allow one-handed operation. The triggermight be integrated into a handle or grip that would allow one hand tocomfortable hold the touchpad and control camera zoom with the otherhand free to operate pan and zoom. Button 230, FIG. 8, on triggercontroller 210 could be used to trigger a still camera image or to startrecording; button 240 could display the still image or to stoprecording. Other functions/buttons are, of course, possible.

The “z” or “zoom” control could be separately controlled by a separatesubsystem. For example, some cameras have wireless remote controls thatcan control zoom.

Interactive, non-visual feedback might be provided from the touch screento the user. Certain areas on the screen could be programmed to providetactile feedback. For example, the user touching any area of the screenthat corresponds to an ‘out of bounds’ area could trigger a continuousvibration from the touch screen or its housing. Or pre-designated spotscould give feedback to the user—perhaps varying intensity, duration, andintervals of vibrations to indicate center court, near and far boundarylines, etc. One long vibration could indicate the center point of thecourt. Two short vibrations could indicate center point of the left freethrow line; two long vibrations could indicate center point of the rightfree throw line, etc. Zoom levels could be preset (within the bounds ofcamera capabilities) if the operator desired to limit zoom-in orzoom-out capability. Feedback from a hand-held touch screen based deviceor the like in the form of vibration, sound, visual signals (e.g., LEDon/off or flashes) are well-known and ubiquitous with regard tohand-held devices, particularly with gaming applications or vibratingSmart Phones.

Just as with other learned skills, intentional reference will normallybe made by the operator to verify results, depending on the qualitydesired and the skill and aptitude of the operator. An operator would beexpected to carefully explore operation during set-up by looking at thescreen and practicing camera control. The operator would also beexpected to glance at the screen from time to time during operation.Further verification of results would be obtained by replaying the stillor video images; there could be immediate benefit to replay duringtime-outs, between periods, etc. The operator would also be able tobenefit from later playback, similar to how conventional photography andvideography is evaluated in post-action playback. Although the resultsof a recording session might be considered acceptable, the operatorcould still notice and correct their technique for x-y (location) and z(zoom) control, for example.

C. Options and Alternatives

The invention may take many forms and embodiments. The foregoingexamples are but a few of those. To give some sense of some options andalternatives, a few examples or additional discussion are given below.

The touchpad could be separate from the screen. A dot, cursor, orhighlighted area could be displayed on a separate screen indicating thetracking position of the camera. Other input devices could be used suchas a joystick, game controller, 3D mouse, etc. Feedback (e.g. vibration)could also be applied to these alternate controllers.

Many other input alternatives would be possible. For example, a ten keystyle pad could be used, where the camera would be calibrated to focuson one of nine separate zones upon command. The user could press asingle key to indicate which zone the camera should focus on.Additionally, “+” and “−” keys could be used to control camera zoom. The“Enter” key could return the camera to a preset wide-angle view of theentire area.

The touch interface could be fitted with a custom guide plate ortemplate, shaped like a typical court or field. The template could havereference features that would be easily identified by touch whichcorrespond to locations on the court. In order to have such an overlayor template, touch screen operation would have to be retained. Thiscould be, for example, a transparency or translucent sheet over thetouch screen that retains the underlying touch screen function ofrecognizing placement of a finger or pressure at a point on the touchscreen. An example of similar overlays is the collection of “CRLQuick-Draw Mirror Cut-out Templates” commercially available fromTechnologyLK (http://www/tecjmp;pgu;l/cp,). This could improve theaccuracy of the correlative touch and feel interface, by helping theuser to control hand/finger movement with reference to the screen butwithout having to look at the screen. This template could be as simpleas a raised edge around the touch screen, or it could provide a detailedtactile model of the court, for example the markings on a basketballcourt might be overlaid on the screen (e.g., with embossments) so thatthe user could feel by just finger-touch and trace around the 3-pointline or the free throw line as the player of interest is moving on thecourt. Additional tactile reference points could be provided either atthe edges of the screen or across the screen as desired.

Multiple templates for different sports and events might be provided, asingle template could be used, or the physical shape and feel of thetouchpad could provide sufficient tactile and spatial feedback to easilycontrol the camera.

Camera controls could include a separate or integrated remote function,such as a trigger or button (e.g. 230, FIG. 8) to initiate recording.Multiple inputs could control camera functions. The remote could beconnected directly to the camera, or could be connected indirectlythrough the touchpad or controller.

Customized Input Screen Example

One example of a customized guided system is shown in FIGS. 5A-B and 6.The screen is fitted with a surrounding overlay 110, FIG. 5A, whichinstalls over touchpad 20; shown in side view. FIG. 5B shows overlay 110fitted to touchpad 20. Overlay 110 is fitted with studs 120. Elasticloops 130, FIG. 6, can be hooked over studs 120. Additionally, moveablemarkers 140 (e.g., small but tactilely discernable members), which aredesigned to cling (e.g., electrostatically or releasable adhesive) tothe touchpad screen can be placed on the touchpad 20. In FIG. 7, loops130 are shown fastened in a pattern that approximates zones in thebasketball court which is displayed on the touchpad 20 (the ability toalign the cord between loops on selective studs 120 allows camera angleperspectives to be approximated for target boundaries). Additionally,moveable markers 140 have been placed to mark the center of the freethrow line on each end of the court. Given the elastic bands marking theedges of each half of the court and the markers at reference pointswithin each court half, the user can easily approximate finger positionon the touchpad with very little need to look at the touchpad duringplay. This allows accurate control of the camera without detracting fromthe experience of watching the game. In other words, the user knows eachhalf of court 100 is bounded by elastic cord material having looped ends130, and the user knows each free throw line has a small marker 140.Without having to look at pad 20, the user can tactilely feel theboundaries of either half of the court and touch screen 90 within thathalf to aim camera 50 there. If aim at or near the free throw line isdesired, the button 140 in that rectangle is located and the touchpad 20touched there.

Other customized guided systems that provided a tactile reference thatcould be correlated to positions on a field or other target or cameraspace could easily be created, as long as a way of tactilely identifyinghand or finger position in relation to the input device is provided.

Uses

Aversion of the exemplary video camera system might be used for variousindoor and outdoor sports such as basketball, volleyball, football,track and field, etc. It could also be used for public events such asconcerts, weddings, plays, and so forth. Multiple screen overlays couldbe developed for different sports or field types to provide ease inadjusting to a given use. In any case, just as an experienced driver mayswitch vehicles with a quick glance at the controls, an experiencedoperator of this system might find the calibration procedure to be veryquick and the operation to be almost without conscious thought. Theresult would be the highly desirable ability to watch and enjoy sportingevents, concerts, etc., while keeping a video record of the event forlater enjoyment.

Use of the system could be expanded from consumer use to institutionaland professional use. Coaching staff could record practice or gameaction using one or more cameras while or in addition to performingother tasks. (Cameras could be mounted permanently for these uses.)Local TV stations could control multiple cameras with only one operator.Large scale broadcasting operations could enhance camera coverage; forexample a commentator/co-anchor could have one or more cameras under hisor her control in addition to the cameras controlled by the director.Olympic type events that ‘do not merit a full camera crew could becovered by one person with one or more cameras under control, allowinggreatly expanded video footage at very little cost. Churches ororganizations wishing to broadcast services or events but having limitedstaff could assign a sound-board operator to control one or more camerasinstead of needing a dedicated operator. A movie director or staff couldcontrol one or more cameras.

Remote Use

Many occasions exist when it would be convenient for a viewer to controla camera at a location which is remote from the event to be recorded.For instance, relatives or team supporters who are unable to personallyattend a game or event might still wish to watch and record the actionsof a child, grandchild, or other favorite player. Likewise, those unableto travel with a high school or college basketball team might want torecord footage of a player or team from a remote location.

Remote use of a camera as discussed above might be enabled simply bymounting a camera to a tripod or fixture in a sports venue andconnecting via internet to touchpad and trigger controls at any locationwith internet access. A primary example is the increasing popularity ofweb-casting college sports. Even mid-major or small universities orcolleges promote live video coverage of multiple sports events for fanssuch as parents that cannot attend. Many times resources (staff andequipment) result in a single static camera view of the whole court, orimprecise and burdensome manual pan/tilt/zoom by an inexperiencedoperator. The present invention could allow better presentation of theevent, even by inexperienced operators. Additionally, it might makefeasible multiple cameras for different coverage and viewing angles.

D. Additional Options and Alternatives

Many options and alternatives are envisioned. For instance, a stillcamera could be used instead of a video camera. Multiple cameras indifferent locations could be interfaced to the computer or processor andcalibrated to the touchpad, to provide multiple views of the action.Multiple cameras recording with different formats, or settings, could berecording from the same location (one camera with a wider angle settingfor instance, in case the action is too quick to follow, etc.). Camerascould be mounted above the court and controlled by touch. Cameras couldbe switched in and out by zones, so that the closest available camerawas always in use.

The calibration procedure is described above in terms of camera havingan elevated view of a horizontal playing court such that the corners ofthe court are easily identified. However, for a camera located near thelevel of the court, the calibration would be oriented mostly towardsleft and right pan, with the overall screen image being a side view ofthe venue. In this case, calibration would primarily reference theamount of left and right pan of the camera and secondarily tilt up ordown. This would be the case for many events such as concerts orweddings where the touch control would mostly be used for pan control ofthe camera.

Additional Notes

A separate camera in addition to the PT controlled camera could be usedto provide a full screen view. Or a single camera could be used suchthat the view on the screen would represent the view being recorded bythe camera. A non-visual touchpad could be used, most likely held in thelap, with a separate screen positioned on the camera tripod for viewing.Multiple displays or display areas could show the full court area forthe touchpad interface as well as the view from the PT-controlledcamera. A split-screen view on a single screen could display cameraspace of plural cameras.

A sports venue or other concern could also provide video feeds which thetouchpad interface or other interface could control or access, either inreal time or as a time-delayed or even post-game feed, to provide acustomized video experience. The venue could rent or provide controls toan in-house system, or provide interfaces to user-supplied recordingequipment. Or user-owned equipment could be interfaced with an in-housesystem. For example, an iPad could connect by cable or wirelessly withthe building system which provides a video feed to the iPad. The userwould manipulate cameras built into the building by touch interface withthe iPad which would relay the command to the building-based system.

The system could be combined with a system using markers, transponders,or even face or number recognition (e.g. to track player jersey number)for camera control/subject tracking. In the case of automated subject(e.g., player) tracking there would be certain periods during the gamewhen the subject (e.g., player) might not be in play but game actioncontinued. Use of this invention in that case would make it possible tocontinue recording the action.

Example of Camera Positioning Based on Touch Screen Input

In order to effect pan and tilt control of a camera in the mannersdescribed above, a touch screen may be used as in input device, withspecific areas on the touch screen assigned to a camera position.Persons having skill in computer servo control or computer numericcontrol (CNC) should easily be able to make this interface. One possibleway to provide this correlation is explained below.

First, the screen is divided into discrete areas. For instance, a touchscreen measuring 8 inches by 10 inches could be divided into 20 one-inchsquares, identified by row indicators (numbers 1-4) and columnindicators (letters A-E). The upper left corner of the screen would bedesignated as “A1” and the lower right corner of the screen would bedesignated as “E4.”

A pan-tilt camera control using stepper motors could then be calibratedto point to the appropriate physical location based on input from thetouch screen, as well as to provide feedback to control software of theactual camera position. For example, a camera could use two separatestepper motors which provide fine control of camera tilt and zoom. Sucha camera could have a home setting designated as X0/Y0. A command tomove (pan) the camera right or left would simply be a positive ornegative X value. So if the camera could pan right or left 90°, thecommand “X−90” would move the camera 90° to the left; “X+90” would panthe camera 90° to the right. Likewise for vertical control, if thecamera had a range of +/−20° from horizontal, a command “Y−20” wouldtilt the camera down 20°; a command “Y+20” would tilt the camera up 20°.Commands for position control could range from “X−90/Y−20” (90° left,20° down) to “X+90/Y+20” (90° right, 20° up) as one example. Addition,the coordinates for the camera position could be queried by controlsoftware, so that for instance the user could use a joystick control,etc. to adjust pan/tile of the camera to a desired orientation,whereupon the software would report an X/Y coordinate to the software.

For use, the camera could be positioned by clamping to a fixed locationsuch as a tripod or balcony railing. A “zero” function would calibratethe camera position to its location. Then the user pan and tilt thecamera to the show its farthest extents in each direction and tocorrelate those extents to the corners of the screen. These extentsmight be as follows:

Touchpad Camera farthest extent Camera farthest extent corners ‘X’coordinate ‘Y’ coordinate A1 X-30 Y0 E1 X-10 Y0 A4 X-30 Y-15 E4 X-10Y-15

Then the software would divide the coordinates by the number ofavailable positions on the touch screen so that the camera would moveevenly within the predefined extents. The resulting correlatedcoordinates might be as follows, with “I” representing “touch padcontrol Input” and X and Y representing desired camera positioningcoordinates):

I X Y A1 −30 0 A2 −30 −5 A3 −30 −10 A4 −30 −15 B1 −25 0 B2 −25 −5 B3 −25−10 B4 −25 −15 C1 −20 0 C2 −20 −5 C3 −20 −10 C4 −20 −15 D1 −15 0 D2 −15−5 D3 −15 −10 D4 −15 −15 E1 −10 0 E2 −10 −5 E3 −10 −10 E4 −10 −15

The result would be that after the calibration procedure, when the usertouches the upper left corner area “A1”, of the touch screen, thesoftware would direct the camera to move to X−30/Y 0; when the usertouches the area “C3” near the center, the software would direct thecamera to move to X−20/Y−10.

The above example could be refined in several ways. For instance, thescreen could be subdivided into much smaller areas; for example thehorizontal range might be from zero to 255 and the vertical range into56 or more, providing 256 individual ‘X’ positions and 56 individual ‘Y’positions. A correction factor for distance (which would compensate fora larger physical area being encompassed by a given degree movement ofthe camera when the object is more distant) could be introduced, eitherby a software calculation or by manual correction. Further calibrationmethods are possible, such as a pixel-by-pixel correlation of thedisplay screen and touchpad interface sensors to a PT position referenceusing one or more identified pixels from the camera. For pixel-by-pixelcorrelation, the extents of the target area would be identified asabove, then each individual pixel or finest division of the touch screencould be assigned a specific X/Y coordinate for the camera.

Example of Calibration Procedure

FIG. 9 illustrates an exemplary calibration procedure 900. Blockscorrespond to general procedures or steps. First, FIG. 9, step 910, acamera is installed in a fixed location such as on a tripod or attachedto the building structure. Second, step 920, by one of several means,the target area is defined on the touch screen. This can include (925)capturing the entire target area as an image, installing an existingtemplate on the touchpad, capturing the target area using anothercamera, using an already existing image, etc. Third (930), the pan/tilt(and possibly zoom) controls are calibrated to the extents of the targetarea. (This can be done (935) by touching the upper left corner of thetouch pad, then using the pan/tilt/zoom controls to move the camera tothe corresponding orientation, so that when the screen is touched in thecorner during operation, the camera will move to view/record that area.)The procedure is repeated for the remaining three corners. Then asufficient number of points within the target area are similarlyaddressed. Next (940) the system is compensated for “included anglearea” (when the camera moves a specified number of steps or degrees, theamount of area on the target area that is swept will vary, depending onfactors (945) that include the distance of the camera from the givenportion of the target area.) This calibration can adjust so that cameramovements are smooth over the entire target area; also zoom levels mightbe adjusted for nearer and farther areas of the target area so that (forexample) a player is displayed at the same relative screen sizeregardless of his or her position on the court.

Once the camera system has been calibrated, the user can begin recording(950). At this point, the basic function of the system is to check forinput (960) from the touchpad. Information from the camera positioningsystem is read by the system controller and compared (970) to thedesired position. The camera aim is then adjusted (980) to provide thedesired image requested by step 960. This process continually repeatsduring operation.

Of course other normal camera functions will be functioningsimultaneously, and many other refinements as discussed above areanticipated.

1. A system for correlative touch and feel control of still or motionpicture cameras which allows a viewer to enjoy sporting or other eventswhile simultaneously controlling high quality capture of still or videoimages, comprising: a. a still or motion picture camera having a fieldof view mounted on a support with a motorized pan and tilt control; b. atouch screen including a display adapted to present a representation ofan event location comprising at least one of (i) the field of view ofthe camera including at least a portion of the field of view, and (ii) arendering or obstruction of the event location; and c. software whichtranslates a user's touch on a position on the representation on thetouch screen into a pan and/or tilt to the camera correlated to theactual event location.
 2. The system of claim 1 wherein the touchscreenand software comprises a physical interface that correlates position orother tactile or spatial reference to multiple camera settings relatingto or comprising one or more of pan, tilt, zoom, focus, and f-stop, andwhich may be manipulated with little or no visual reference to theinterface.
 3. A method for a person to record by photograph or video anevent at an event location while being able to watch substantiallycontinuously the event comprising: a. positioning a camera (still orvideo) relative to the event location so that its aiming direction isgenerally towards the event location and its field of view can captureat least a substantial portion of the event location; b. positioning theperson to have a direct view of the event location; and c. communicatingchange of aiming direction, zoom, or field of view instructions to thecamera via correlative touch and feel control by the person which doesnot materially disrupt or obstruct the person's view of the event. 4.The method of claim 3 wherein the correlative touch and feel controlcomprises one or more of: a. a touch screen; b. a joystick; and c. ahand held control with levers and/or buttons.
 5. The method of claim 4wherein the camera includes mechanized pan, tilt, and zoom capabilities.6. The method of claim 5 wherein the control is correlated to themechanized pan, tilt, and zoom capabilities of the camera so that manualoperation of the control produces a correlated change on pan, tilt, orzoom of the camera.
 7. The method of claim 3 wherein the cameracomprises a still or video camera or both.
 8. The method of claim 3further comprising providing sensory feedback to the person relative toa change or aiming direction, zoom, or field of view instruction.
 9. Themethod of claim 8 wherein the sensory feedback can be associated with atleast one of: a. a particular aiming direction; b. a particular zoomsetting; c. a particular point in the field of field; d. a boundary inthe field of view; e. a particular point of the event location; and f. aparticular boundary of the event location.
 10. The method of claim 9wherein the sensory feedback can differ for different associations. 11.The method of claim 8 wherein the sensory feedback can be: a. tactile;b. audible; c. visual; or d. combinations of any of the above.
 12. Themethod of claim 3 wherein the positioning of the person is: a. at ornear the camera; b. away from the camera at the event location; c. awayfrom the camera at a different site than the event location.
 13. Asystem for a person to record by photograph or video an event at anevent location while being able to watch substantially continuously theevent comprising: a. a camera with mechanized zoom, pan and tilt toallow two-degree freedom of movement adjustment of aiming direction andfield of view and zoom adjustment; b. a manually operated controloperatively connected to the camera to control at least zoom, pan andtilt; c. a correlation between the manually operated control and pan,tilt, and zoom of the camera to allow correlative touch and feel controlof the camera to allow the person to adjust the camera during recordingof the event without material disruption or obstruction of the person'sview of the event.
 14. The system of claim 13 wherein the manuallyoperated control comprises one or more of: a. a touch screen; b. ajoystick; and c. a hand held control with levers and/or buttons.
 15. Thesystem of claim of claim 13 wherein the manually operated controlcomprises a touch screen and software which: a. correlates a cameraspace image of the event location to a range of pan and tilt adjustmentsof the camera; and b. provides feedback to the person of present cameraaiming or camera field of view position.
 16. The system of claim 15wherein the feedback can be one or more of: a. tactile; b. audible; andc. visual.
 17. The system of claim 16 wherein the tactile feedbackcomprises physical structure on the manually operated control whichindicates some end of range of pan or tilt, or some characteristic orboundary of the event location.
 18. The system of claim 17 wherein thephysical structure comprises one or more of: a. a tactilely discernablevariation on the control; b. an adjustable member; c. a differentiatedtexture or surface.
 19. The system of claim 18 wherein the manuallyoperated control further comprises camera record, pause record, stoprecord instructions or other camera operation instructions.
 20. Thesystem of claim 13 wherein the manually operated control is in operativecommunication with the camera via one or more of: a. wired; b. wireless;or c. a combination of two or more of the above.
 21. The system of claim13 wherein the pan and tilt control and the zoom control are different.22. A kit for a person to record by photograph or video an event at anevent location while being able to watch substantially continuously theevent comprising: a. a camera with mechanized zoom, pan and tilt toallow two-degree freedom of movement adjustment of aiming direction andfield of view and zoom adjustment; b. a touch screen comprising amanually operated control operatively connected to the camera to controlat least zoom, pan and tilt; and c. software providing a correlationbetween the manually operated control and pan, tilt, and zoom of thecamera to allow correlative touch and feel control of the camera toallow the person to adjust the camera during recording of the eventwithout material disruption or obstruction of the person's view of theevent.
 23. A method for a person to record by photograph or video anevent at an event location while being able to watch substantiallycontinuously the event comprising: a. positioning a camera relative tothe event location so that its aiming direction is generally towards theevent location and its field of view can capture at least a substantialportion of the event location; b. positioning the person to have adirect view of the event location; c. correlating the manually operatedcontrol and pan, tilt, and zoom of the camera; and d. adaptivelylearning the correlation between the control and the camera by practiceor use; e. to allow the person to acquire correlative touch and feelcontrol of the camera to allow the person to adjust the camera duringrecording of the event without material disruption or obstruction of theperson's view of the event.
 24. The method of claim 23 furthercomprising providing sensory feedback to the person to notify the personof some aspect of the pan, tilt or zoom instruction relative to apredetermined parameter.
 25. The method of claim 24 wherein thepredetermined parameter comprises: a. boundary of the event location; b.limit on range of pan, tilt or zoom; or c. a feature in the eventlocation.